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TTTTjE of the invention 



IMAGE DISPLAY SYSTEM, IMAGE DISPLAY METHOD, STORAGE 



MEDIUM, AND COMPUTER PROGRAM 



BACKGROUND OF THE INVENTION 



Field of the Invention 



[0001] 



The present invention relates to an image display 



system for presenting an image on a screen in response to a 
position indicated by a pointer. 
Dfiscript inn of the Related Art 

[0002] There are conventionally available projection-type 
image display systems for use in presentations and 
conferences. By directly inputting coordinates using a 
pointer on the screen of a large display, a computer 
connected to the display is controlled. Characters and 
drawings are thus input. Some typically available systems 
incorporate a video camera in a projection-type display 
apparatus. The video camera picks up an emitter of the 
pointer, detects the position of the pointer, and a 
coordinate signal is then sent to the connected computer. 
[0003] The brightness level on the screen of the 
projection-type display is raised to a level high enough to 
be used even in a lighted room. As computers are in 
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widespread use, the demand on the pro ject ion- type display 
apparatus of this sort is mounting. In particular , a front 
projection apparatus is useful because of its portability , 
and varying image magnification in response to an available 
screen size. 

[0004] However, since an operator needs to use a pointer 
in front of the screen in the front projection apparatus, 
the screen is shadowed by the pointer and the operator, and 
a cursor can become invisible. 

SUMMARY OF THE INVENTION 



[0005] Accordingly, it is an object of the present 
invention to provide an image display system which is 
smoothly operated and projects an image which is pointed at 
by a pointer but not overshadowed by the pointer. 
[0006] To achieve the above object, in one aspect, an 
image display system of the present invention for displaying 
an image on a screen in response to a position of a pointer, 
includes a projection-type image display unit for displaying 
the image on the screen, a detector for detecting 
coordinates responsive to the position of the pointer, and a 
display controller for displaying an image indicating the 
position pointed by the pointer at position coordinates 
spaced by a predetermined distance from the position 
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coordinates detected by the detector. 

[0007] In a preferred embodiment , the image display system 
includes a modifier for modifying the predetermined distance. 
[0008] The modifier is preferably a switch. 
5 [0009] The pointer may include a plurality of switches, 

and a combination of the plurality of switches may determine 
the direction of the position coordinates at the 
predetermined distance . 

[0010] Preferably, the modifier modifies the predetermined 
10 distance by pointing to a modification display presented on 
the screen with the pointer. 

[0011] A detection area of the coordinate detector may be 
larger than a display image area on the screen by at least a 
maximum settable value of the predetermined distance. 

15 [0012] Preferably, the display controller controls the 
predetermined distance in response to the position 
coordinates detected by the detector. 
[0013] The display controller may control the 
predetermined distance in proportion to the distance of the 

20 position coordinates detected by the detector from the edge 
of the screen. 

[0014] To achieve the above object, in another aspect, an 
image display system of the present invention for displaying 
an image on a screen in response to a position of a pointer, 
25 includes an image display unit for displaying the image on 
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the screen , and a detector for detecting coordinates 
responsive to the position of the pointer, wherein the 
pointer includes a plurality of light emitters with one of a 
hollow section and a transparent section interposed 
5 therebetween . 

[0015] Preferably , the detector detects the center of 
light quantity from the emitter as the position coordinates 
pointed by the pointer. 

[0016] The light emitter is preferably an optical fiber. 
10 [0017] The detector preferably detects a peak value 

position of the light from the optical fiber as the position 
coordinates pointed by the pointer. 

[0018] Other features and advantages of the present 
invention will be apparent from the following description 
15 taken in conjunction with the accompanying drawings, in 
which like reference characters designate the same or 
similar parts throughout the figures thereof. 



[0019] The accompanying drawings, which are incorporated 
in and constitute a part of the specification, illustrate 
embodiments of the invention and, together with the 
description, serve to explain the principle of the invention. 
25 [0020] FIG. 1 generally shows a projection-type image 
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display system of a first embodiment of the present 
invention; 

[0021] FIG. 2 is a functional block diagram of the 
projection-type image display system of the first embodiment 
5 of the present invention; 

[0022] FIG. 3 roughly shows the construction of a pointer 

of the first embodiment of the present invention; 

[0023] FIG. 4 is a table listing operation modes of the 

pointer of the first embodiment of the present invention; 
10 [0024] FIG. 5 shows a display screen in accordance with a 

second embodiment of the present invention; 

[0025] FIG. 6A shows the display screen of the second 

embodiment of the present invention; 

[0026] FIG. 6B shows the display screen of the second 
15 embodiment of the present invention; 

[0027] FIG. 7 is a functional block diagram showing a 
projection-type image display system of a third embodiment 
of the present invention; 

[0028] FIG. 8 is an external view of a pro ject ion- type 
20 image display system of a fourth embodiment of the present 
invention; 

[0029] FIG. 9 roughly shows the construction of a pointer 
of the fourth embodiment of the present invention; 
[0030] FIG. 10 is a table listing operation modes of the 
25 pointer of the fourth embodiment of the present invention; 
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[0031] FIGS. 11A-11C are waveform diagrams showing output 
signals of the pointer; 

[0032] FIG. 12 roughly shows the pointer of a fifth 
embodiment of the present invention; 
5 [0033] FIG. 13 roughly shows the pointer of a sixth 
embodiment of the present invention; 

[0034] FIG. 14 is a flow diagram showing the process of a 
coordinates corrector for switching between two types of 
offsets to the right-hand side and the left-hand side; 
10 [0035] FIG. 15 is a flow diagram showing the process of a 
coordinates corrector for varying gradually the offset; 
[0036] FIG. 16 is a flow diagram showing the process of a 
coordinates corrector for varying the offset in response to 
a position within a screen; 

[0037] FIG. 17 shows a control window for driver software 
presented on a screen 5; 

[0038] FIG. 18 is a flow diagram in which the offset in a 
cursor position is controlled using the control window of 
the driver software shown in FIG. 17; and 
[0039] FIG. 19 shows a control window that permits the 
cursor to be selectively offset in six directions. 
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25 [0040] Preferred embodiments of the present invention will 
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now be described in detail in accordance with the 
accompanying drawings. 

[0041] The embodiments of the present invention will now 
be discussed, referring to the drawings. 

First Embodiment 



[0042] FIG. 1 shows an image display system of a first 
embodiment of the present invention, and FIG. 2 is a 

10 functional block diagram of the projection-type image 
display system of the first embodiment. Each of the 
elements shown in block outline in the figures are 
individually well known per se, and their internal 
construction and operation is not critical to the making or 

15 using of this invention or to a description of the best mode 
of the invention. 

[0043] Referring to FIG. 1, the image display system 
includes a pro ject ion- type image display apparatus 2, a 
screen 5 on which an image is presented, a coordinates 

20 detector 1 for detecting position coordinates of a light 

emitter 41 mounted on the end of a pointer 4, and a computer 
3. An image signal generated by the computer 3 is input to 
the projection-type image display apparatus 2, while a 
control signal and position coordinates of the light emitter 

25 41 detected by the coordinates detector 1 are input to the 
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computer 3. The coordinates detector 1 is mechanically 
fixed to the projection-type image display apparatus 2. The 
installation position of the projection-type image display 
apparatus 2 is adjusted so that an image is projected in a 
desired location and a desired size on the screen 5. 
[0044] With reference to FIG. 2, the pointer 4 includes 
the light emitter 41 composed of red LEDs (Light Emitting 
Diodes), a light emission controller 42 for controlling 
light emission of the light emitter 41, and a plurality of 
operation switches (SW) 43. The light emission controller 
42 turns on and off light emission and modulates light in 
accordance with the status of the four operation switches 
43A-43D, thereby performing light emission control with a 
control signal superimposed on light. 

[0045] The coordinates detector 1 includes an infrared 
video camera 11, a coordinates calculator 14 for calculating 
coordinates from the output signal from the infrared video 
camera 11, a photosensor 12 and a control signal detector 13 
for detecting the control signal from the pointer 4. A 
communication controller 16 has the function of sending 
coordinate signals and control signals to the computer 3 and 
receiving a mode control signal for switching an operational 
state in response to a command from the computer 3. The 
coordinates detector 1 also includes a coordinates corrector 
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[0046] The coordinates detector 1 detects the position 
coordinates of the light emitter 41 and the control signal 
responsive to the switches, to be discussed later, of the 
pointer 4, and sends these pieces of information to the 
computer 3 . 

[0047] in response to an image signal input from the 
computer 3, the projection-type image display apparatus 2 
presents the corresponding image information on the screen 5 
The computer 3 superimposes a cursor (a position pointing 
image) 55L on the image signal, and changes the image 
location and size of the cursor 55L in response to the 
coordinate information and the control signal from the 
coordinates detector 1. The computer 3 thus performs a 
variety of processes to changes the display image. 
[0048] Text information and line drawing information are 
input on the screen 5 by the pointer 4, and then presented 
by the projection-type image display apparatus 2. The 
information is input and output as if performed using "a 
pencil and paper." Further, an input operation using a 
button and an icon selection is freely performed. 
[0049] The projection-type image display system of the 
first embodiment is now specifically discussed. 



Detailed Discussion of the Pointer 4 
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[0050] FIG. 3 roughly shows the construction of a pointer 
of the first embodiment of the present invention. 
[0051] Referring to FIG. 3, the pointer 4 includes the 
light emitter 41 for emitting an infrared light ray, a light 
emission controller 42 for driving and controlling light 
emission of the light emitter 41, and four operation 
switches 43A-43D in the first embodiment. The light 
emission controller 42 turns on and off light emission and 
modulates light in accordance with the status of the four 
operation switches 43A-43D, thereby performing light 

emission control with a control signal superimposed on light. 

[0052] The operation mode of the pointer 4 is now 

discussed, referring to FIG. 4. 

[0053] FIG. 4 is a table listing operation modes of the 
pointer of the first embodiment of the present invention. 
[0054] Switches A-D correspond to switches 43A-43D in FIG. 
3. Referring to FIG. 4, "EMISSION" corresponds to a light 
emission signal (a coordinate signal) and "PEN DOWN" and 
"PEN BUTTON" correspond to control signals. The modulation 
of light here is well known in connection with widely used 
remote controllers, and the discussion thereof is skipped. 
[0055] The operator holds the pointer 4 in front of the 
screen 5 with the light emitter 41 pointing to the 
coordinates detector 1 . The operator grips the pointer 4 in 
a manner such that the thumb of the operator naturally 
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touches the switch 43A. Pressing the switch 43A causes the 
light emitter 41 to start emission. The coordinates 
detector 1 operates, outputting a coordinate signal in a 
predetermined process thereof, in this state, the control 
signals for a pen down operation and a pen button operation 
are still off. The screen 5 indicates only the movement of 
the cursor and the position pointing to the user in a button 
switching operation for high lighting. 
[0056] Pressing the switches 43C and 43D, which are 
positioned to be respectively conveniently touched by the 
index finger and the middle finger, the control signals for 
the pen down operation and the pen button operation are 
superimposed on the emitted light signal. Specifically, 
with the switch 43C pressed, the pen down state is activated, 
15 thereby permitting a text or line drawing to be entered, and 
further, screen controlling for button selection may be 
performed. With the switch 43D pressed, the pen button 
state is activated, and a different function such as calling 
a menu may be performed. The operator operates the system 
smoothly and quickly in a single-handed fashion, such as 
writing a text or drawings at any position on the screen 5, 
or selecting buttons and menus. 

[0057] Like the switch 43A, the switch 43B is mounted in a 
position that permits easy access by the thumb of the 
25 operation, and is thus difficult to press together with the 
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switch 43A. This is because there is no need to press the 
two switches together. Since the switch 43B is less 
frequently used than the switch 43A, it is preferred that 
the switch 43B is arranged to be less accessible. When the 

5 switches 43C and 43D are pressed with the switch 43B pressed, 
a signal LEFT or a signal RIGHT is issued with the control 
signals for the pen down operation and the pen button 
operation off. The signal LEFT and the signal RIGHT are 
used to vary the offset that is added to or subtracted from 

10 the output coordinates in the coordinates corrector 15, 

rather than being output from the coordinates detector 1 to 
the computer 3 . 

[00581 With the switches 43C and 4 3D pressed in front of 
the screen 5, the cursor position is shifted to 55L, 55, or 

15 55R as shown in FIG. 5. 

[0059] As shown, the cursor 55 at an offset zero position 
is partly overshadowed by the pointer. With the cursor 55 
shifted to 55L or 55R, the cursor becomes fully visible, 
helping the operator in the curser operation. Depending on 

20 whether the operator stands on the right-hand side or on the 
left-hand side of the screen 5, the operator selects between 
the cursors 55L and 55R, whichever is easier to handle. In 
the first embodiment, the operator easily switches between 
the cursors 55L and 55R on the pointer 4. 

25 [0060] Referring to a flow diagram shown in FIG. 14, the 
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process of the coordinates corrector for switching between 
two types of offsets to the right-hand side and the left- 
hand side is shown. 

[0061] As shown, Xk and Yk represent predetermined offsets, 
and Xm and Ym represent offset variables, having immediately 
previously set status, and X and Y represents coordinates. 
The origin of the coordinate system is set at the top left 
of the screen, and X is positive in the leftward direction, 
and Y is negative in the downward direction. 
[0062] When the control signal detector 13 detects a 
control signal and when the coordinates calculator 14 
detects an effective coordinate input signal, it is 
determined in step S1402 that an input is present. In steps 
S1403, S1404, and S1405, the status of control signals RIGHT 
and LEFT is checked. When the signal RIGHT only is on, Xk 
is substituted for Xm, and Yk is substituted for Ym in step 
S1406. When the signal LEFT only is on, -Xk is substituted 
for Xm, and Yk is substituted for Ym in step S1408. When 
the signals RIGHT and LEFT are on, Xm and Ym are reset to 
zero in step S1407. When the signals RIGHT and LEFT are off, 
Xm and Ym are not updated. Using the set Xm and Ym, the 
coordinates X and Y are updated in step S1409. The 
coordinate information is transferred to the communication 
controller 16 in step S1410. 

[0063] in this way, with the signal RIGHT on, the cursor 
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shifts to the top right, with the signal LEFT on, the curser 
shifts to the top left, and with both the signal RIGHT and 
LEFT on, the cursor reverts back its original position. 
This setting is continuously effective thereafter. 
[0064] The offset value is one type for each of the 
leftward and rightward direction. Alternatively, the offset 
value may be variable. In such a case, the offset value may 
be gradually changed by repeating the operation of the 
switches . 

[0065] Referring to the flow diagram shown in FIG. 15, the 
process of the coordinates corrector for varying gradually 
the offset is discussed. 

[0066] As shown, Xk represents a predetermined maximum 
offset value, X0 represents a variable offset at one time, 
Xm and Ym represent offset variables, having immediately 
previously set statuses, and X and Y represent coordinates. 
FIG. 15 is different from FIG. 14 in the process subsequent 
to the examination of the status of the control signals 
RIGHT and LEFT in steps S1503, S1504, and S1505, and the 
difference only is discussed here. 

[0067] When the control signal RIGHT only is on, Xm is 
increased by XO in step S1506, and the maximum of Xm is 
limited so that Xm is equal to or smaller than Xk in step 
S1509, and Ym is equalized with the absolute value of Xm. 
When the control signal LEFT only is on, Xm is decreased by 
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XO in step S1507, the minimum of Xm is limited in step S1510 
so that Xm is equal to or larger than -Xk, and Ym is then 
equalized with the absolute value of Xm. When the two 
control signals RIGHT and LEFT are on or off, the flow 
5 remains unchanged from that in FIG. 14. Using Xm and Ym 

thus set, the coordinates X and Y are modified in step S1511, 
and the coordinate values are transferred to the 
communication controller 16 in step S1512. 

[0068] in this way, the offset is gradually increased from 
10 the top left to top right with the control signal RIGHT on, 

from top right to top left with the control signal LEFT on. 

The setting thus applied is continuously effective in the 

subsequent operation, and concurrently pressing the switches 

resets the setting. 
15 [0069] The same sequence may be performed by using 

switches and dials, which may be arranged on the coordinates 

detector 1, rather than using the switches on the pointer 4. 

For example, the display operation will be smoother if the 

rate of change per touch in the switches 43C and 43D is set 
20 by a dial on the coordinates detector 1, and the offset 

modification is performed on the switches 43C and 43D on the 

pointer 4 . 

[0070] The operation of each block in the coordinates 
detector 1 will be now discussed in detail, referring to FIG. 
25 2. 
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Detailed Description of the Coordinates Detector 1 

[0071] The coordinates detector 1 includes the photosensor 
12 for receiving a light intensity modulated signal, and the 
infrared video camera 11 for detecting the direction in 
which a light beam comes in. The photosensor 12 and the 
infrared video camera 11 receive the light beam from the 
light emitter 41 built in the pointer 4. 

Operation of the Control Signal Detector 13 



[0072] The operation of the control signal detector 13 for 
detecting the control signal in the output signal from the 
15 photosensor 12 is identical to the technique widely used in 
the infrared remote controller. This technique is 
sufficiently robust to external disturbances and receives a 
sufficiently high-speed control signal. The control signal 
received is sent to the coordinates corrector 15. 



Operation of Coordinates Calculator 14 



[0073] An effective display area 51 of the infrared video 
camera 11 in the first embodiment is slightly larger than 
25 the image display area of the screen 5 as shown in FIG. 5. 
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The light emitted by the light emitter 41 within the 
effective display area 51 appears on an output signal as a 
peak. First, the light emitter 41 is operated to emit light 
in the four corners of the screen, and the coordinates 
calculator 14 stores data serving as a reference for the 
calculation of the coordinates from the peak position of the 
output signal from the infrared video camera 11. Any 
position coordinates of the light emitter 41 is detected 
referring to the peak position of the output signal from the 
infrared video camera 11 to calculate the position 
coordinates . 



Operation of the Coordinates Corrector 15 

15 [0074] The position coordinates thus obtained are sent to 
the coordinates corrector 15, where an offset value is added 
to or subtracted from the position coordinates. The offset 
position coordinates information is sent together with the 
control signal from the control signal detector 13 to the 

20 computer 3 via the communication controller 16. The 

coordinates corrector 15 changes the offset in response to 
the signals LEFT and RIGHT of the control signals, and sends 
the remaining control signals intact through the 
communication controller 16. With the above-referenced 

25 switching operation of the pointer 4, the cursor and buttons 
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within the presented image are manipulated. The cursor thus 
may become 55L, 55, or 55R. 

[0075] When the offset is modified using the switches and 
dials arranged on the coordinates detector 1 as described 
5 above, the coordinates corrector 15 simply detects the 
offset instead of using the control signals. 

[0076] The effective display area 51 of the infrared video 
camera 11 is larger than the display screen by approximately 
the maximum settable offset value. In this arrangement, no 
10 inoperable area occurs within the screen even during the 
offset operation. 

[0077] In accordance with the first embodiment, the cursor 
is not overshadowed by the pointer on the screen. The 
operator comfortably operates the image display system, 
15 adjusting the offset to the operator's own preference. An 
eaS y_to-use projection-type image display system thus 
results . 



Second Embodiment 

20 

[0078] in a second embodiment, the offset is varied 
according to the location of the cursor within the screen, 
i.e., the coordinates of the cursor as shown in FIGS. 6A an< 
6B. Specifically, the offset gradually increases from a 
25 constant value in proportion to the distance from the lower 
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edge of the screen in a vertical direction or from the right 
side edge of the screen in a horizontal direction. Since it 
suffices to set the effective display area 51 of the 
infrared video camera 11 larger by a constant value, the 
5 second embodiment is advantageous from the standpoint of the 
optical system of the infrared video camera 11 and the 
resolution thereof. 

[0079] With reference to a flow diagram shown in FIG. 16, 
the process of the coordinates corrector for varying the 
10 offset in response to a position within a screen is 
discussed. 

[0080] As shown, Xk and Yk are predetermined offsets, Xm 
and Ym are offset variables, having the immediately 
previously set statues, and X and Y are coordinates, and 
15 fl(X), f2(X), and g(Y) are functions for respectively 

varying fightward offset, leftward offset, and Y-direction 
offset depending on the location within the screen. The 
process in FIG. 16 remains unchanged from the sequence where 
offset variables Xm and Ym are changed depending on the 
20 statuses of the control signals RIGHT and LEFT as shown in 
FIG. 14. The flow diagram shown in FIG. 16 is different 
from that shown in FIG. 14 in the sequence in step S1609 and 
subsequent steps, and the difference only will now be 
discussed . 

25 [0081] The process branches off from step S1609 depending 
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on the sign of the offset variable Xm. When the offset 
variable Xm is positive, Xm x fl(X) is added to X in step 
S1611. As X changes from X=0 (at the left edge of the 
screen) to X=XMAX (at the right edge of the screen), the 
function fl(X) gradually increases with the maximum value 
thereof being one. For example, assuming that f 1 (X)=X/XMAX, 
the offset increases in proportion to the distance from the 
left edge of the screen, and reaches the maximum value Xm in 
the vicinity of the right edge of the screen. A variety of 
other functions is contemplated, and any appropriate 
function is acceptable. In the Y direction, Ym x g(Y) is 
subtracted from Y. As Y changes from Y=0 (the top edge of 
the screen) to Y=YMAX (at the bottom edge of the screen), 
the function g(Y) gradually decreases with the maximum value 
thereof being one. For example, assuming that g( Y )=1-Y/YMAX, 
the offset increases in proportion to the distance from the 
bottom edge of the screen, and reaches the maximum value Ym 
in the vicinity of the top edge of the screen. 
[0082] When Xm is negative, Xm x f2(X) is added to X in 
step S1612. Conversely, the function f2(X) gradually 
decreases as X changes from X=0 to X=XMAX, with the maximum 
value thereof being one. For example, assuming that 
f2(X)=l-X/XMAX, the offset increases in proportion to the 
distance from the right edge of the screen, and reaches the 
25 maximum value Xm thereof at the left edge of the screen. 
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The offset in the Y remains unchanged when Xm is positive. 
[0083] When Xm is zero, X and Y are output intact, and no 
offsetting is performed. In this way, corrected X and Y 
coordinates are transferred to the communication controller 

5 16 in step S1613. 

[0084] in this way, in response to the position within the 
screen, the control signal RIGHT changes the offset in the 
top right direction and the control signal LEFT changes the 
offset in the top left direction. 
10 [0085] In the case shown in FIG. 15 where the offset is 
gradually changed, the process steps in step S1609 
thereafter in FIG. 16 are substituted for step S1511 in FIG. 
15. 

[0086] There are a variety of methods for varying the 
15 offset in response to the location within the screen, and 

these methods fall within the scope of the present invention. 
It is important that inputting be performed over the entire 
screen without excessively enlarging the effective display 
area 51 and that the cursor not be overshadowed in the 
20 offset motion. 



Third Embodiment 



[0087] Referring to FIG. 7, the coordinates detector 1 
25 does not include a coordinates corrector (as in FIG. 2), 
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offset control signals are directly output to the computer 3. 
The driver software in the computer 3 for processing the 
coordinate signal and the control signal performs coordinate 
correction. This arrangement presents no problem at all. 
5 [0088] Referring to FIGS. 17, 18, and 19, the sequence of 
the driver software in the computer 3 for controlling the 
offset of the cursor position is discussed. 
[0089] FIG. 17 shows a control window of the driver 
software shown on the screen 5, and switches whether to 
10 perform offsetting using on and off buttons. Although the 
offsetting is performed in one direction only over a 
constant distance in this case, the distance and direction 
may be variable. When the on command is designated on the 
screen, a pen driver recognizes the on command. The pen 
15 driver adds an offset to the coordinates sent from the 
coordinates detector 1. In case of the off command, no 
offset is added. 

[0090] FIG. 18 shows a flow diagram for controlling the 
offset of the cursor position using the control window of 

20 the driver software shown in FIG. 17. In step S1801, the 
computer 3 determines whether a STOP command is entered. 
When it is determined that the STOP command is entered, the 
driver software control window ends. When the computer 3 
determines that no STOP command is entered, then the 

25 computer 3 determines in step SI 80 2 whether there is an 
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output signal from the coordinates detector 1. When it is 
determined that no output signal is provided by the 
coordinates detector 1, the process returns to step S1801. 
When the computer 3 determines that the coordinates detector 
1 provides the output, then the computer 3 determines 
whether OFFSET is on or off (step SI 803). When it is 
determined that the OFFSET is on, the computer 3 outputs, to 
a system software in a display computer, coordinates that 
are obtained by subtracting offsets Xm and Ym from the 
coordinates X and Y set from the coordinates detector 1. 
When it is determined that the OFFSET is off, the computer 3 
outputs, to the system software in the display computer, the 
coordinates X and Y sent from the coordinates detector 1. 
[0091] FIG. 19 shows a control window that permits the 
15 cursor to be selectively offset in six directions. As shown, 
the cursor leftwardly upwardly moves in a slanted direction 
to a black dot. 

[0092] It is possible that the control by the driver 
software and the offsetting in the coordinates detector 1 

20 may be concurrently performed. 

[0093] The control signals LEFT and RIGHT discussed in the 
first embodiment and the second embodiment may be output to 
the computer 3, and the driver software in the computer 3, 
which processes the coordinate signal and the control 

25 signals, may also perform coordinate correction. This 
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arrangement is perfectly acceptable. 
[0094] In accordance with the first through third 
embodiments, the cursor is displayed using the position 
coordinates that are spaced apart from the end of the 

5 pointer 4 by the predetermined distance so that the cursor 
may not be overshadowed by the pointer 4. The predetermined 
distance can be modified using the switches on the pointer 4. 
Not only the cursor remains visible without being 
overshadowed by the pointer 4, but also the size of the 

10 projected image and the offsetting are adjusted to the 
operator's own preference. 

Fourth Embodiment 

15 [0095] FIG. 8 is an external view of a pro ject ion- type 

image display system of a fourth embodiment of the present 
invention. 

[0096] Elements identical to those described in connection 
with the image display system of the first embodiment are 

20 designated with the same reference numerals, and the 

discussion thereof is skipped. The construction and the 
function of the elements of the image display system of the 
fourth embodiment remain unchanged from those of the third 
embodiment shown in FIG. 7. 

25 [0097] The pointer 4 includes three light emitters 41, 



such as red LEDs . The three light emitters 41 emits light 
in response to an identical signal. The coordinates 
detector 1 detects the position coordinates of the light 
emitter 41 , and the control signal responsive to the switch 
status, to be discussed later, of the pointer 4, and sends 
these pieces of information to the computer 3. 
[0098] When receiving an image signal from the computer 3, 
the projection-type image display apparatus 2 displays the 
image information onto the screen 5. The computer 3 
superimposes the cursor 55 on the image signal. In response 
to the coordinate information and the control signal from 
the coordinates detector 1, the computer 3 changes the 
location and the size of the cursor 55, and modifies a 
displayed image by performing a variety of processes. 
[0099] The projection-type image display system of the 
fourth embodiment will now be discussed in detail. 

Description of the Pointer 4 

[0100] FIG. 9 roughly shows the construction of a pointer 
4 of the fourth embodiment of the present invention. 
[0101] Referring to FIG. 9, the pointer 4 includes the 
three light emitters 41 emitting infrared light, a light 
emission controller 42 for controlling the light emission of 
the light emitters 41, and three operation switches 43A-43C. 
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The three light emitters 41 are arranged on a ring, and the 
ring has a hollow inner circle as large as possible. The 
light emission controller 42 turns on and off light emission 
and modulates light in accordance with the status of the 
three operation switches 43A-43C, thereby performing light 
emission control with a control signal superimposed on light. 
[0102] The operation modes of the pointer 4 are now 
discussed, referring to FIG. 10. 

[0103] FIG. 10 is a table listing operation modes of the 
pointer of the fourth embodiment of the present invention. 
[0104] Switches A-C correspond to the switches 43A-43C 
shown in FIG. 9. Referring to FIG. 10, "EMISSION" 
corresponds to a light emission signal (a coordinate signal) 
and "PEN DOWN" and "PEN BUTTON" correspond to control 
15 signals. The modulation of light is well known in 

connection with widely used remote controllers, and the 
discussion thereof is skipped. 

[0105] The operator holds the pointer 4 in front of the 
screen 5 with the light emitter 41 pointing to the 

20 coordinates detector 1. The operator grips the pointer 4 in 
a manner such that the thumb of the operator naturally 
touches the switch 43A. Since the orientation of the light 
emitter 41 reverses depending on whether the operator stands 
on the right-hand side of and on the left-hand side of the 

25 screen 5, the end portion of the pointer 4 may be set to be 
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turned for switching. Pressing the switch 43A causes the 
light emitter 41 to start emission. The coordinates 
detector 1 operates, outputting a coordinate signal in a 
predetermined process thereof. In this state, the control 
signals for a pen down operation and a pen button operation 
are still off. The screen 5 indicates only the movement of 
the screen 5 and the position pointing to the user in a 
button switching operation for high lighting. 
[0106] Pressing the switches 43B and 43C, which are 
positioned to be respectively conveniently touched by the 
index finger and the middle finger, the control signals for 
the pen down operation and the pen button operation are 
superimposed on the emitted light signal as shown in FIG. 10. 
Specifically, with the switch 43B pressed, the pen down 
15 state is activated, thereby permitting a text or line 

drawing to be entered, and further, screen controlling for 
button selection may be performed. With the switch 43C 
pressed, the pen button state is activated, and a different 
function such as calling a menu may be performed. The 
operator operates the system smoothly and quickly in a 
single-handed fashion, such as writing a text or drawings at 
any position on the screen 5, or selecting buttons and menus, 



20 



Operation of the Coordinates Calculator 14 
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[0107] As in the first embodiment , an effective display 
area 51 of the infrared video camera 11 is slightly larger 
than the image display area of the screen 5 in the fourth 
embodiment. The light emitted by the light emitter 41 
5 within the effective display area 51 appears like a peak of 
a hilly output signal. The light emitters 41 are 
successively operated to emit light with the end of the 
pointer 4 placed on the four corners of the screen, and the 
coordinates calculator 14 stores data serving as a reference 

10 for the calculation of the coordinates from the center of 
light quantity of the hilly output signal of the infrared 
video camera 11. Any position coordinates of the light 
emitter 41 is detected referring to the position of the 
center of light quantity of the hilly output signal from the 

15 infrared video camera 11 to calculate the position 
coordinates . 

[0108] The position coordinates thus obtained are sent to 
the computer 3 together with the control signal from the 
control signal detector 13. The above-discussed switching 

20 operation on the pointer 4 allows the cursor and buttons to 
be operated on the display screen. The display cursor 55 
appears in the same manner when the light emitter 41 is 
operated in alignment with the four corners of the screen 5 
to obtain data as a reference. In the fourth embodiment , 

25 the three light emitters 41 are used and the center 
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surrounded by them is hollow. It is natural to align the 
hollow portion with an image. Since the cursor 55 appears 
within the hollow portion, the operator comfortably operates 
the pointer 4 monitoring the cursor 55 without concerning 
himself with the shadow 40 of the pointer 4. 
[0109] A transparent member with a cross-hair mark 
attached may extend in the hollow portion. In this 
arrangement, the cross-hair mark and the cursor overlap each 
other, and a fine and detailed work such as writing 
characters is easily performed. The robustness of the end 
portion of the pointer 4 is also increased. The use of a 
transparent member makes the cursor 55 slightly less visible, 
because the transparency thereof is not 100%. It is 
advisable to use the transparent member, depending on 

15 applications. 

[0110] The output signal of the infrared video camera 11 
becomes split with a plurality of peaks as shown in FIG. 
11(B), depending on the resolution and the focused state of 
the infrared video camera 11 and the size of the light 

20 emission point and the separation between the light emission 
points of the light emitters 41. If the center of light 
quantity is used, however, the intermediate point between 
the light emitters 41 is determined in this case. 
[0111] A coordinate input device that calculates a 

25 position by detecting a peak may suffer from degradation in 
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accuracy, and the present invention is not applicable to 
such a device. 

[01121 The posture of the pointer 4 is determined by the 
manner in which the operator grips the pointer 4 . For this 
5 reason, the light emitter 41 must be a spreading light 
source. As the spread angle of the light source becomes 
wide, the effect of the posture is reduced, but the light 
intensity drops. An appropriate spread angle needs to be 
selected. To vary the spread angle, not only the 
10 characteristics of the LEDs in the light emitter 41 are 

selected, but also optical elements such as a diffuser and a 
lens may be used. When such optical elements are added, the 
light spot size changes, thereby affecting the output signal 
of the infrared video camera 11. However, position 
15 calculation is performed selecting an appropriate method. 
[01131 in accordance with the fourth embodiment, the 
operator comfortably operates the system with the cursor 55 
free from being overshadowed by the pointer 4 on the screen 
5. An easy-to-use pro ject ion- type image display system 
20 results. 

Fifth Embodiment 

[0114] FIG. 12 shows the pointer 4 having a ring of light 
25 emitters 41 regularly arranged on a circle to which light is 
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guided through optical fibers. In a fifth embodiment, light 
is substantially equally distributed along the circle, and 
the output signal of the coordinates detector 1 appears in a 
smooth hill shape. In this case, the position calculation 
may be performed on a peak position rather than the center 
of light quantity. 



Sixth Embodiment 
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[0115] FIG. 13 shows the pointer 4 having two light 
emitters 41. In this case, two separate peaks may result as 
shown in FIG. 11(C). Depending on the posture of the 
pointer 4, the spacing between the two peaks changes, and 
the peak shown in FIG. 11(A) can also result. In this case, 
15 as well, the center of light quantity is a midway point 
between the two light emission points, and the position 
calculation is performed without any problem. The sixth 
embodiment uses only two LEDs. 

[0116] In accordance with the fourth through sixth 
20 embodiments, a plurality of light emitters is mounted on the 
end of the pointer 4, and the center section thereof is 
hollow, i.e., open, or is provided with a transparent member 
so that the cursor is not overshadowed by the pointer 4. 
The center of light quantity is used to calculate the 
25 position coordinates. Even if the light emitters are spaced 



apart from each other, the position within the hollow 
section or the transparent section is accurately detected. 
[0117] In the first through sixth embodiments/ the 
coordinates detector 1 employs a video camera. The present 
invention is not limited to this. Other detectors, such as 
ones employing an electromagnetic induction method or an 
ultrasonic method, may be used. Other detectors employing 
light, for example, a line sensor or PSD (Position Sensing 
Device) may be equally used. 

[0118] The computer 3 is used as an image generator. 
Alternatively, video equipment may be used. The present 
invention is applicable to any apparatus which receives a 
coordinate signal and generates an image signal responsive 
to the coordinate signal. 

[0119] in accordance with the present invention, the image 
pointed by the pointer is prevented from being overshadowed 
by the pointer. A comfortably operable image display system 
is thus provided. 

[0120] While the present invention has been described with 
reference to what are presently considered to be the 
preferred embodiments, it is to be understood that the 
invention is not limited to the disclosed embodiments. On 
the contrary, the invention is intended to cover various 
modifications and equivalent arrangements included within 
the spirit and scope of the appended claims. The scope of 
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the following claims is to be accorded the broadest 
interpretation so as to encompass all such modificati 
equivalent structures and functions. 



